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(54) Predictive and pulsed illumination of a surface in a micro-texture navigation technique 



(57) An optica! navigation system saves power by 
pulsing its surface illumination light source (3) to provide 
light only when needed. The level of light. may be con- 
trolled by a servo-mechanism that monitors degree of 
correlation data arid average Illumination, - and that 
changes the controlled level at times when it is both 
required and safe to do so. As for creating different lev- 
els of illumination, that may be accomplished by: [1] 
pulsing the. light on (23) and then opening the electronic 
shutter for some period of time (24) during the pulse 
(gating the light); [2] opening the shutter and then vary- 



ing the pulse wiclth of the light (21 , 22) (gating the LED); 
[3] opening the shutter and then pulsing the LED at dif- 
ferent intensities (19, 20); and [4] a combination of [2] 
and: [3]. In. addition, the velocity of the navigation circuit 
over the surface (or vise versa) can be determined, and 
in cases where.it is safe to assume that limited acceler- 
ation' is possible, at low velocities It Is desirable 1 to 
reduce the rate of data acquisition, and thereby pulse 
. the light sources less often and conserve power. 
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WaT,ON T^^ U.S. Patent.5, 644, 139 entitled 

(issued 1 Ju,y .97), to that ^^^S^^^lT^n^^ REUTIVE T ° ^ S 
AT|VE MOVEMENT BY CORRELATING S GNALS FTOM AN ARRAY F ° R TRACK,NQ REL " 

and ateDto that disclosed in U.S. Patent Applications oq/nR5ni« T PH0T0 ELE MENTS (Issued 17 Mamh '98) 

MICRO-TEXTURED SURFACES, filed on the eame dl th.7 . RV ° F0R OPTIC AL NAVIGATION OVER 

Hastings, and assigned to Hewlett-Packed ol ZZ ^ " ™ ™ a P p " Catl0n b * C. Oliver and Brian L. 

Applications 09/052, 046 and EXPOSURE S E R VO TO^O PTI^AL^ M/fn at! S ^ ' ^ 139 * 6 ' 729 > 008 U ' S - 
FACES are each hereby ln^M h ^%^^ ° PT ' CAL NAV(G ATION OVER MICRO-TEXTURED SUR^ 
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instances of a previous !mage with new images oSl^l™*^*" by COrre,atin 9 » 
ease of use and outstanding accuracy. S of f 'k f 98 flbwB in a sheet of P a P sr - 

generic term for such a technique is WSat on" a„7lt cent I " !" inC ° r P oratet < P« documents. A 
wideruseas itbecomes more widely kn J n 7^ I* p ^sonably.be expected that it will come into ever 
cations that optica, navigation i3 *u «r^Fo "^^f a ha* n 7h^ ;™" mF ? i0n te ° fte " an " rasue in th « ^ «PP-f- 
ered device than as one powered from the AG ^tSSStlESZll T" ^ * S 8 batt6ry fl- 

optical navigation is a further example . V powered computer operated with a mouse that uses 

-Sthet:^ 

out benefit of a mechanical shutter. Ideate so ^aZ^^T"*! eXP ° S6C,t0 the i[,um " 1atsd ™9 a w*h- 
value only in response to a signal to do so U^mTso^^ 0the ™" s « trans ^^ from light to an electrical 
that interfere with making measurements whenThe ^SlSS" 6XperienCe b,as > he ™" a 

have an electronic shutter, but the nature of the £S jLSSSL j ? ' beln9 0ff " 11,658 dev,bes 08,1 sti » ° e "Id to 
types of photosensitive devices the «2S EJrSSS T ? " 9ht ^ ^ There are however - 
tronic shuttei* and are less sensitive to the bias^fn™ / J ^ nav| 9 ation > that both have elec- 
allowing the powersavlngs of pJS^JSff^S^S^ ^ 93 USed ,n ^ M 

ing such an army of sensors °P°™°"- Our interest herein Is dtrected to an optical navigation system hav- 

Sitm^ 

rate. Ordinarily, simplicity In a complex system Is a welcome ™!L I 1, V contI " Uou ^ a maximum 

tlon and maximal sampling do not work- thevT llKiK?^ 2 h ' S CBSe K ,S not <™«™°us Illumina- 
formed with |R (ln fra Red) LED's and tea ^Sl™ ' * unfortunate ' v Rumination of the surface Is p er - 
If ft. optica, navigation technique cou be modS 3T7 ^ ' S " W ° U ' d be desirabla 

its ability to reliably keep irack of Where it is A re d Zt ten T„ r " lurnlna *° n on de ™nd without interfering with 
-t is the taking of the samples thet TZ ^Z^Z S^' " 0UW *° bS ^ 9S 
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average illumination, and that changes the 3£ h3 a tZ aa S I d89r6e ° f "«Mon*|. and 

creating different levels of illumination that ? , ' S b ° th requir9d and safe to do so - As for 

tronic shutter for some period of time Sl pS 

pulse width of the light (gating the LED)- <31 ooLinn thi «h « L 9 ( } ° pening the shutter and varying the 
(4) a combination of(2) and 3). ^i^^^JS^ZZ^^ *" LE ° ^ jnte n s ^fand 
determined, and In cases where It Is safe a ^ZtlZfu^Ln 3 T Mt ° Ver the surface < or v[ss verea) can be 
low v B ,ocme s it is deslmble to id Z tna ^te oJ cSa 222 * { ^ 3 ™ ^ ■ at 

serve power. The reduction can be a calculated mSTI! ^ the "W so »™ often and con- 

a worst case acceleration, or it can .'hil^S^t^ rhT' y ? eCSSSary t0 ^ am P ,e «^*»*<* °" 
pulses and honoring others. conservative estimate that involves suppressing normally scheduled 
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Brief Description Of The Drawings 
[0006] 

5 Figure 1 [s a simplified block diagram illustrating certain aspects of a system Incorporating optical navigation In 

which there is a beneficial reduction in power consumption produced by controlling exposure with a pulsed a light 
source; 

Figure 2 Is a simplified waveform diagram illustrating a method of varying exposure forth© optical navigation circuit 
of Figure 1 that relies upon adjusting LED drive pulse height; 
10 Figure 3 is a simplified waveform diagram illustrating a method ,of varying exposure for the optical navigation circuit 
.of Figure 1 that relies upon adjusting LED drive pulse width; 

Figure 4 is a simplified waveform diagram illustrating a method of varying exposure for the optical navigation circuit 
of Figure 1 that relies upon- adjusting effective LED drive pulse width by gating the resulting light with an electronic 
shutter signal; 

75 Figure 5 is a simplified waveform diagram illustrating a method of reducing power consumption for the optical nav- 
igation circuit of Figure 1 by controlling the rate of sampling according to the relative velocity; and 
Figure 6 is a simplified waveform diagram illustrating a method of reducing power consumption for the optical nav- 
igation circuit of Figure 1 by suppressing regularly scheduled samples to control the rate of sampling according to 
the relative velocity, 

20 

Description Of A Preferred Embodiment 

[0007] - Refer now to Figure 1 , wherein Is shown a simplified black diagram 1 of a system Incorporating, optical nav- 
igation. In particular, It Is battery powered by a battery operated power supply 18, although this is not an essential 
25 requirement; even circuits operated from the AC mains can benefit from reduced power consumption (longer compo- 
nent life, less heating, no fan, etc) ' 

[0008] An optical navigation circuit 2, which may be as described or similar to those described in the incorporated 
material, is proximate a surface 5 whose micro-texture Is illuminated by one or more LED's 3, Light 4 from the LED's 3 
is reflected from surface 5, and some of that reflected light 6 enters an aperture (not shown) of the optical navigation 

30 circuit 2. Theoptlcal navigation circuit 2 -registers changes in its physical location relative to the surface 5 by tracking 
the apparent motion of micro-texture produced patterns In an array of photo-sensltlve devices (not shown) proximate 
the aperture. Correlation techniques between present and past frames of pixel images are used to do this, as explained 
In considerable detail in the Incorporated documents. We term this process of tracking motion "navigation." It will be 
appreciated that the optical navigation circuit 2 is an IC (Integrated Circuit) of considerable size, and that it has an 

35 amount of self-contained processing power commensurate with the task. It is not by itself an entire system, however, 
and its outputs (8-12) are used by an outer layer of processing for some production of some result (13). 
[0009] Accordingly, note that several outputs from the optical navigation circuit 2 are applied to- a system controller 
7 that does produce a system output 13 (e.g., a scanned Image or a position). The outputs from the opticalnavigatlon 
circuit 2 Include an average Illumination value 8, correlation bowl data 9, incremental motion signals 1 1 for X and Y 

40 axes, and other data 12. In addition, there are other control inputs 10 that originate wjth the system controller 7, such 
as a reset signal, and other signals for various housekeeping functions. , 

[001 0] A word is in order about the correlation bowl data signals 9, and we pause briefly to digress. Recall that we 
said that navigation involves tracking apparent movement of a pixel pattern. This is realized by comparing a data frame 
to a reference frame. The comparison is made by shifting the contents of one frame relative to the other by one pixel in 

45 some direction and asking if the pixel values In the various locations are the same for, Is the sum of all their respective 
differences zero, or so). The comparison "In some direction" Is performed for a pixel displacement in all directions: one 
up, one down, one left, one right; one up and one left, one up and one right, one down and one left, and, one down and 
one right. That is a total of eight comparisons. But we mustn't forget that there might have been no movement, so we 
also need result for no shifting. That makes nine comparison values that correspond in principle to what we have termed 

50 correlation values. The one that is the lowest represents the relative motion we are tracking, To be more robust in this 
process, we could go also to the next nearest pixel positions, which would raise the number of correlation values to 
twenty-five. The correlation process is explained In considerable detaj[ in the incorporated documents. The "bowl" is 
simply the three dimensional plot of the correlation amplitudes versus the shifted position they represent. The signifi- 
cance of the bowl, besides indicating movement or the lack thereof, Is that Its shape gives rise to confidence that the 

55 navigation process is working as it is Intended to. For example, if the bowl is "flat" we can presume that there is not 
enough contrast amongst the pixels to navigate upon. That Is a serious situation that is to be avoided during navigation. 
Lack of excursions in the bowl may be brought on by changes In the surface as navigation proceeds, and might be cor- 
rectable by changes in exposure. 
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lL.ro.. their .5™?E™SSSS»! 7SS *? T W°» <l««o» (no, ^ md „,„. 
.sensed. Typtoajy then, the .suiting exposure w, be a function of the LED drhle signal 5 an/thV S££S?. 4 

nn!« T e , any electronics ^^ * turned to be open during the durations of pulses 9 and 20 

S 2 ; lthin the durat,on of LED drive pu,ee 23 < but might IJ^£S£Z^% 

event ft Is their period of simultaneous ex.8tenoe that produces an effective LED pulse width 27 by the shutter's effect 
SjS^h £ h0to - S8nSitive elements t0 the *". P«1od Indicated by dashed Enes 25 and ! 26 i 

any change to an existing scheme for deciding how often samples are to be taken 9 
[001 7J There Is yet anothertechnique thatcan be used to effect such savings, and that Is to control the rate at which 
samples are taken. This may be practiced Independently, or In conjunction with one of the -?<SJ^S£to 

? e n„th f t- ^ t6Ch : lqUe iS ShOWn iR Fi9Ures 5 and 6 - Ttlese ****** ™ based on ttaSSSSHES 
ength oftime ,s required to take a sample frame and perform correlation, and thatthera Wm^SS^SSt 

TIT* BX? l d ' ? We " 38 00 the permitted relative veloci ^ betwee " ^ navigation circuit and 5ie »S» Thte 
knowledge can be usedto reduce the sampling ^rate when the relative velocity Is low or zero 

be «hiL i„I P T f ° r eXamF !l e ' * " Z6ra Suppose a,so that the reference ^ u»B,h« most or all of Its ability to 
be shifted mtact Then we can determine with assurance a minimum sampling rate that will guarantee even ? we don't 
samp e during some initial movement, that the next data frame will still, be correlated wES Terence frame aJ 
reducing he sampling , rate to that value we save powerby avoiding unneeded uses Jth^SX^^fS^V 

SSJTi? Ve ' 0City ' ^ ^ adjUSt thSt S9m P' e rate V™* » needed S^it «5il 

advantage although a lesser savings | n power will be possible. It may be necessary to consider ho™ V sh Z the 
reference frame has experlanced. and derate the reduction In sampling rate for that, as wel * 

ura I sett Z X S !l e S Ure t * h l epiCtS S firSt train ° f pUlS6s 27 > wh,ch re P res ^ sampling (with whatever expo- 
ZVl } elatlve , n ' 9h rate ' perfiaps even a maxima ' ^e. This is in contrast to the situation somewhat later in 
time where sampling pulses 28 and 29 are issued at a considerably lower rate In this figure the actual sam^nn ^I = 

[0020 In Figure 6 a sim.lar result is obtained, but through a method that may be easier to implement in some svs 
emsjn this method the basic repetition rate of the sampling pulses is fixed, bj Individ a saX Opu ses aTgated ■ 

Snn 1 L n ° na method ° f febmplWihg the variable rate sampling described above Is to repeatedly compute a sam- 
pHng rate based upon relative velocity and the associated parameter of system behavior, such as maxZum allowed " 
acceleration and maximum allowed velocity, all considered in light of the amount of apparent motion aZed be we^ 
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a reference frame and a data fame (that Is, th.e:amount of shifting that can be accommodated therebetween), A simpli- 
fication would be to partition the range of allowable velocities into ranges, such as zero to one Inch per second, one to 
three Inches per second, three to nine Inches per second, and above, A look-up table could then provide conservative 
safe values for the sampling rate at each of these velocities, thus saving the overhead of repeatedly re-calculating sam- . 
5 ' pljng rates. 

. [0022] , For example, consider an optical navigation circuit having a forty-seven by forty-seven of photo-sensors 
spaced on forty micron centers. If the velocity were zero and we assumed a maximum acceleration of ,5g, then in order 
to ensure less than one pixel of motion between consecutive data frames we can allow at most a time Interval of about 
4 msec between frames. That is: 

70 

x - displacement = 1/2at = pixel spacing 

[0023] Solving fort; 
w t = Jzx/.a 

[0024] Where: 

a= 5 m/sec 2 = V& g and x = 40 * 1Q~ 6 metBrs = one pixel 

20 ~ 

[0025] The maximum sample rate for the above system Is about 100 usee Intervals between consecutive samples 
at a velocity of about .4 meters per second. Now, from 4 msec to 100 usee is a forty-to-one change in sample rate, which 
represents quite a savings In power when the lower rate Is possible. In this example one can, If desired, associate sam- 
ple rates with velocities by interpolating along the line having abscissas from zero velocity tD .4 m/sec and correspond- 
25 ing ordl nates of 4 msec to 1 00 usee. As mentioned above, one could either repeatedly solve the equation for that line 
or (preferably) pre-load sample rates Into a look-up table indexed by velocity. With a forty-to-one ratio, it would be appro- 
priate to partition the velocity into perhaps as many as sixteen or thirty-two different entries in the look-up table. 

f 

Claims 

30 

1. A method of exposing to light (4) a surface (5) having a micro-texture upon which an optical navigation circuit (2) 
tracks movement, the method comprising the steps of: 

(a) determining a desired exposure level; and 
as (b) illuminating the surface with a pulse of light (19, 20) having an intensity selected to produce the desired 

exposure level. 

2. A method of exposing to light (4) a surface (5) having a micro-texture upon which an optical navigation circuit (2) 
tracks movement, the method comprising the steps of: 

40 

(a) determining a desired exposure level; and 

(b) illuminating the surface with a pulse of light (1 9, 20) having a duration selected to produce the desired expo- 
sure level, 

45 3. A method of exposing to light (4) a surface (5) having a micro-texture upon which an optical navigation circuit (2) 
tracks movement, the method comprising the steps of: 

(a) determining a desired exposure level; and 

(b) illuminating the surface with a pulse of light (23); and 

so (c) operating in the optical navigation circuit an electronic shutter for a duration (24) that Is selected to produce 

the desired exposure level, 

4. A method of exposing to light (4) a surface (5) having a micro-texture upon which an optical navigation circuit (2) 
tracks movement/the method comprising the steps of: 

55 

' (a) Illuminating the surface with pulses of light (27) occurring at a selected rate; 

(b) determining a velocity from the tracked movement; 

(c) increasing the selected rate In response to increases in the determined velocity; and 
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(d) decreasing the selected rate in response to decreases ] n the determined velocity. 
5. A method as in daim 4 wherein steps (c) and (d) are computed increases and decreases, respectively. 
^ ^-eT + « - „ comprise o b tainln 9 
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,HIGH EXPOSURE 
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FIG.2 (LED PULSE AMPLITUDE) 
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FIG.3 (LED PULSE 
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FIG.4 (GATE LIGHT WITH SHUTTER) 
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FIG.5 (VARIBLE RATE SAMPLING) 
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FIG . 6 (SUPPRESSED CYCLE SAMPLING) 
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